Towards Facial Gestures Generation by Speech Signal Analysis Using HUGE Architecture
نویسندگان
چکیده
In our current work we concentrate on finding correlation between speech signal and occurrence of facial gestures. Motivation behind this work is computer-generated human correspondent, ECA. In order to have a believable human representative it is important for an ECA to implement facial gestures in addition to verbal and emotional displays. Information needed for generation of facial gestures is extracted from speech prosody by analyzing natural speech in real-time. This work is based on the previously developed HUGE architecture for statistically-based facial gesturing and extends our previous work on automatic real-time lip sync.
منابع مشابه
Towards real-time speech-based facial animation applications built on HUGE architecture
This paper examines how our existing HUGE architecture aids fulfilling requirements emerging from the everyday expansion of new multimedia applications. Trends in humancomputer interaction stream towards creating natural user interfaces which apply rules from human-human interaction. Virtual humans who look natural, and behave believably fit perfectly in the concept of creating natural user int...
متن کاملQualitative and Quantitative Crying Analysis of New Born Babies Delivered Under High Risk Gestation
Multimodal Human Machine Interactions in Virtual and Augmented Reality p. 1 Speech through the Ear, the Eye, the Mouth and the Hand p. 24 Multimodality Issues in Conversation Analysis of Greek TV Interviews p. 40 Representing Communicative Function and Behavior in Multimodal Communication p. 47 Using the iCat as Avatar in Remote Meetings p. 60 Using Context to Disambiguate Communicative Signals...
متن کامل[HUGE]: Universal Architecture for Statistically Based HUman GEsturing
We introduce a universal architecture for statistically based HUman GEsturing (HUGE) system, for producing and using statistical models for facial gestures based on any kind of inducement. As inducement we consider any kind of signal that occurs in parallel to the production of gestures in human behaviour and that may have a statistical correlation with the occurrence of gestures, e.g. text tha...
متن کاملAnimation of talking agents
It is envisioned that autonomous software agents that can communicate using speech and gesture will soon be on everybody’s computer screen. This paper describes an architecture that can be used to design and animate characters capable of lip-synchronised synthetic speech as well as body gestures, for use in for example spoken dialogue systems. A general scheme for computationally efficient para...
متن کاملAutomated Gesturing for Embodied Animated Agent: Speech-driven and Text-driven Approaches
We present two methods for automatic facial gesturing of graphically embodied animated agents. In one case, conversational agent is driven by speech in automatic Lip Sync process. By analyzing speech input, lip movements are determined from the speech signal. Another method provides virtual speaker capable of reading plain English text and rendering it in a form of speech accompanied by the app...
متن کامل